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Abstract 

An analysis of the relative motion and point feature model configurations leading to solution degeneracy is presented, 
for the case of a Simultaneous Localization and Mapping system using multicamera clusters with non-overlapping 
fields-of-view. The SLAM optimization system seeks to minimize image space reprojection error and is formulated for 
a cluster containing any number of component cameras, observing any number of point features over two keyframes. 
The measurement Jacobian is transformed to expose a reduced-dimension representation such that the degeneracy of 
the system can be determined by the rank of a dense submatrix. A set of relative motions sufficient for degeneracy 
are identified for certain cluster configurations, independent of target model geometry. Furthermore, it is shown that 
increasing the number of cameras within the cluster and observing features across different cameras over the two 
keyframes reduces the size of the degenerate motion sets significantly. 

Keywords: SLAM, Computer vision. Multicamera cluster. Non-overlapping FOV, Degeneracy analysis. Critical 
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1. Introduction 

Precise robotic motion and manipulation tasks with 
respect to unknown target environments and objects re¬ 
quire an accurate, real-time measurement of the relative 
position and orientation of the robot and target. Mul¬ 
ticamera systems are often employed for robotic pose 
and target model estimation, as each camera is an in¬ 
expensive, light-weight, and passive device capable of 
collecting a large amount of environment information at 
high rates. Many researchers across different fields have 
investigated the use of cameras for the purpose of esti¬ 
mating motion and scene structure. As a result, many 
techniques using a variety of camera types and configu¬ 
rations have been detailed in the literature. 

A camera cluster is composed of any number of sim¬ 
ple perspective cameras mounted rigidly with respect to 
each other, as shown in Figure Q] including configura¬ 
tions in which their fields-of-view (FOV) are spatially 
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disjoint iQJ. This arrangement makes effective use of 
the camera sensors to cover a large combined FOV with 
high resolution, and in general, is able to overcome the 
limitations of other camera configurations, such as scale 
and translation-rotation motion ambiguities (2l- Addi¬ 
tionally, by arranging the cameras to look in many di¬ 
rections, the pose estimation is made more robust since 
when certain cameras do not see any point features suit¬ 
able for tracking, the other cameras in the cluster can 
maintain the localization. In this scenario, camera ar¬ 
rangements with a smaller collective FOV may become 
lost causing the tracking operation to fail. 

In order for any pose estimation system to operate 
successfully, the current state must be uniquely recover¬ 
able given the measurable outputs up to, and including 
the current time step. In the context of a multicamera 
cluster relative pose system, this means that the image 
measurements must contain sufficient information to re¬ 
cover the cluster motion and the target model parame¬ 
ters, including the proper global scale metric. Further¬ 
more, the solution must be unique since convergence to 
a different configuration, which may also agree with the 
measurements, would likely result in failure of percep¬ 
tion and control operations. 
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Figure 1: An example camera cluster in which the three 
component cameras are rigidly-fixed with respect to 
each other. 


When the multicamera cluster is configured such 
that there is little or no spatial FOV overlap between 
the component cameras, the sensitivity of the image 
measurements to the global scale of the reconstructed 
model is low, particularly around specific motion pro¬ 
files known as critical motions 0], When the relative 
motion of the cluster is at or near critical, the global 
scale of the solution is extremely difficult, if not impos¬ 
sible, to recover accurately. In the presence of measure¬ 
ment noise, the solution will converge to an incorrect 
scale value. 

This work investigates the degenerate configurations 
when estimating the Simultaneous Localization and 
Mapping (SLAM) 0] system states for a calibrated mul¬ 
ticamera cluster over two keyframes while observing a 
set of point features in each camera and using an it¬ 
erative optimization or recursive filter-based approach, 
minimizing the image space reprojection error of point 
feature measurements. This includes Bundle Adjust¬ 
ment (BA) 0 ] schemes as well as recursive filters such 
as an extended Kalman filter 0. The main contribu¬ 
tion is the identification of configurations of motion and 
target model structure leading to non-unique SLAM so¬ 
lutions. 

Determining the system configurations leading to so¬ 
lution degeneracy is closely related to the concept of 
observability in control systems. In the study of observ¬ 
ability for nonlinear systems, the local weak observabil¬ 
ity of the system can be determined by calculating the 
observability rank condition about any point in the state 
space 0. This involves checking the column rank of 
a matrix containing the partial derivatives with respect 
to the system states, for increasing orders of Lie deriva¬ 
tives of the measurement model with respect the the sys¬ 
tem dynamics. When the matrix has full column rank, 
the system is locally weakly observable about that point. 

For a SLAM system using only the visual measure¬ 


ments from the cluster cameras and a non-stationary tar¬ 
get, the system does not have a model of the dynamics 
for the relative motion and therefore, only the zeroth- 
order Lie derivatives are non-zero. In this case, eval¬ 
uating the observability rank condition is equivalent to 
checking the rank of the measurement Jacobian matrix, 
as will be done here in the degeneracy analysis in Sec- 
tion[4] If the system were to contain a model of the rel¬ 
ative motion dynamics, and the extra information that 
comes with it, the higher-order Lie derivatives of the 
measurement model would contain non-zero terms and 
the added matrix rows would only increase the likeli¬ 
hood that the matrix has full column rank at any point 
in the state space. However, in this analysis, no such as¬ 
sumptions about the relative motion dynamics are made 
and the degenerate configurations arising from only us¬ 
ing image measurements for a set of point features over 
two keyframes are identified. 

The remainder of this paper is arranged as follows: 
Section [2] contains a review of the previous analyses 
for degenerate configurations of the multicamera cluster 
relative pose system; Section [3 presents the multicam¬ 
era cluster SLAM system; the degenerate configurations 
of the pose estimation system are identified in Section 
|4l and finally, conclusions are drawn in Section|5] 

2. Related Work 

Previous analyses identifying cluster motions leading 
to degenerate system solutions have assumed that the 
five degrees of freedom describing relative orientation 
and translation direction of the cluster are known using 
the well-studied single camera ego-motion estimation 
techniques (e.g. 0). These include the work of Kim et 
al. 0, and Clipp et al. 0 for camera clusters with two 
component cameras, as well as that of the authors 0 
for clusters with three component cameras. Of interest 
are the conditions when the image measurements from 
the camera cluster are able to allow for estimation of the 
final degree of freedom, corresponding to the translation 
magnitude and therefore, global system scale. The anal¬ 
yses show that when each point feature is seen by only 
one of the two cameras at both keyframes, the global 
scale of the solution solution is recoverable only when 
the relative translational and rotational motion are both 
non-zero, and does not result in the optical centres of 
each camera moving in concentric arcs on circles with 
a common centre at the intersection of the baselines at 
each keyframe 0 . When a third non-collinear camera 
is added to the cluster, the set of degenerate motions is 
reduced to those which result in all the three cameras 
moving in parallel 0. 
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Analyses of degeneracies of the full SLAM solution 
for multicamera clusters have focused on those associ¬ 
ated with solving the generalized camera relative pose 
problem, either linearly using the Generalized Essential 
Matrix (GEM) 0], or aligning imaging rays in space for 
minimal cases of camera poses and points EH- Sturm 
[11], Stewenius et al. lIlOll . and Mouragnon et al. 1121 
discuss some degenerate cases, but Kim and Kanade 
El provide the most complete analysis. They identify 
the following degenerate configurations forjjeneralized 
cameras using the seventeen point method 


1. All of the observation rays pass through one com¬ 
mon point before and after the camera motion. 

2. The camera centres are on a line before and after 
the motion. 

3. Each corresponding ray pair passes through the 
same local point in the general camera frame be¬ 
fore and after the motion. 


For a camera cluster with non-overlapping FOV, it is 
possible that each component camera observes its own 
mutually exclusive set of feature points over the two 
keyframes. In this case, the system satisfies condition 
3 and the solution to the seventeen point algorithm is 
always degenerate. However, it is known from pre¬ 
vious results that in certain configurations, other solu¬ 
tion methods are able to recover an accurate estimate 
of the motion and structure. Consequently, the seven¬ 
teen point algorithm does not always recover a solution 
when one exists. This problem was noticed by Li et 
al. El, who have since modified the algorithm for use 
with non-overlapping clusters, but the subsequent de¬ 
generacy analysis has not been carried out. More impor¬ 
tantly, the degenerate configurations are specific to the 
linear method of estimation. In this work, the minimiza¬ 
tion of image-space reprojection error is considered and 
the configurations for which an optimization of this type 
will fail are identified in the subsequent analysis. 


3. Multicamera Cluster Pose Estimation 


maps a point x in the real vector space to its representa¬ 
tion in the projective space, 

p(x) = [x T l] T . (1) 

The projective demotion operator n„ : IP" —> R" maps a 
point x in the projective space back to the corresponding 
point x the real vector space. 
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Note that the result of this operator is undefined for 
points at infinity. 

In this work, unless it is ambiguous from the context, 
the promotion and demotion operators will be implied 
by the vector notation. The homogeneous coordinates 
for a given vector x e R" will simply be written as x e 
P", but implicitly, x = p(x), and likewise, x = n„ (x) 
assuming x„+i + 0. 

3.2. Pin-hole Camera Model 

An individual component camera within the cluster 
is modelled as a simple pin-hole imaging device, which 
maps 3D points onto a 2D plane called the image plane 
1 15h . An example is shown in Figure [2] A 3D point 
p c ' = | x Ci y C ' z Ci l] , represented in the projec¬ 
tive space P 3 , and expressed with respect to the I th cam¬ 
era coordinate frame, C,-, is projected onto the image 
plane /,. The intersection of the point feature ray p Ci , 
through the optical centre, owith the image plane oc¬ 
curs at the point, | u v] e M 2 . It is assumed that each 
camera has been intrinsically calibrated using one of the 
many existing offline techniques EL such that the mea¬ 
surements are made to match the structure shown. 

The camera projection matrix, x,, maps the point in 
P 3 into P 2 on the image plane. It is assumed in this 
work, without loss of generality, that the projection ma¬ 
trices for all of the cameras have the form. 


3.1. Projective Geometry 


The projective space P" (refer to Appendix A for a 
brief introduction) provides a convenient way of rep¬ 
resenting the camera measurement system in terms of 
homogeneous transformations and points Et]. It will 
sometimes be necessary to move between the respective 
real and projective space representation of points, and 
the following promotion and demotion operators are de¬ 
fined. The projective promotion operator p : R" —» P" 


Ki = 


-1 

0 

0 


0 0 0 

-10 0 
0 1 0 


(4) 


The point p C| is projected into P 2 on the image plane. 


~ ~ r 

P ' = Kip l . 


(5) 


then subsequently mapped to the actual image plane co¬ 
ordinates in R 2 through the demotion function ni for 
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Figure 2: A simple pin-hole camera measurement model is used to relate the camera frame coordinates to the camera 
image plane coordinates for a feature point. 


P 2 , 


*2(P') 


M = 


* 0 . 


( 6 ) 


Each camera is assumed to have an FOV strictly less 
than 180 degrees and therefore, is only able to observe 
points in front of the lens so every point is constrained 
to have a positive z-axis coordinate. 


> 0 , 


(7) 


which satisfies 


3.3. Calibrated Multicamera Cluster 

Collectively, the calibrated camera cluster is mod¬ 
elled as a set of n c component pin-hole cameras 
with known relative coordinate transformations be¬ 
tween each camera coordinate frame. Accordingly, a 
point p c '’ in the camera frame C/,, can be transformed 
into any other camera frame C, by, 

pC, = X Q pC„ (8) 


where T^' e SE( 3), V;,/; e {1 ,...,n c ), is a homoge¬ 
neous transformation matrix in SE( 3) 11611 . Without 
loss of generality, the coordinate frame for the camera 
cluster is chosen to coincide with the first camera frame, 
C\. The transformation from camera h to the cluster 


frame can be written in shortened form as Tq, = , 

where the cluster frame C i is implied when the super¬ 
script is neglected. The transformation is shown in Fig¬ 
ure m 



Figure 3: The relative position and orientation of each 
camera is known relative to the cluster frame, C\ and 
therefore, the position of points in any camera frame 
can be found with respect to the cluster frame using the 
known transformation, T C( . 


3.4. Point Feature Target Object Model 

The tracked target object or environment, henceforth 
referred to simply as the target, is a rigid body which 
contains a set of visible point features. A point feature 
is a visually distinguishable point on the tracked phys¬ 
ical target that corresponds to a unique 3D position in 
a local target coordinate frame M, and is measurable in 
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a set of camera images through a relative motion se¬ 
quence. Image measurements of these point features 
are extracted from the images using image processing 
techniques, including feature extraction algorithms like 
the FAST corner detector [17 I 1811 . the Scale-Invariant 
Feature Transform (SIFT) 19], or Speeded-Up Robust 
Features (SURF) |2()|. 

The target model point features are organized into n* 
keyframes, each a six degree of freedom pose with re¬ 
spect to the target model reference frame M, along with 
the n c images from the cluster cameras captured at that 
location, as in [21j] lor a single camera. The coordinate 
frame of camera h at keyframe k is denoted C'/, k).. 

Since the relative position and orientation of each 
camera within the cluster is fixed at all times, the k th 
keyframe pose is parameterized by the single homoge¬ 
neous transformation for the cluster coordinate frame at 
the keyframe, C\Kk, with respect to the target model 
reference frame, M, resulting in T ^ Kk e SE(3). The C\ 
and M frames are applied universally in this keyframe 
pose definition, and therefore, the transformation will 
be written simply as T^. = T c K ■ The pose of camera 
h at keyframe k is easily found as, 


T M _ rr rp 

C h K k ~ l K k LC h - 


(9) 



Figure 4: An example target object model with two key- 
frames for a two-camera back-to-back cluster. The cam¬ 
eras look outwards with the green arrows showing the 
optical axes. The point feature j is anchored, and there¬ 
fore, positioned within the CL K\ coordinate frame. The 
relative pose of camera 2, Tc,, is known from calibra¬ 
tion, but the relative pose of keyframe 2, IV,, as well as 
the position of the point features must be estimated. 


The position of the / h point feature is parameterized 
by the azimuth and altitude angles of the vector from the 
origin of the anchor camera coordinate frame through 
the feature, p, = [cf>j,0j] T where <pj,6j e (-|, The 
depth along this bearing to the point feature, is the value 
Sj e R \ The bearing angles are used to form the unit 
vector in the camera coordinate frame at the first key- 
frame. 




sin (f>j cos 6j 
- sin 6j 
cos <pj cos Qj 


( 10 ) 


and the point feature position is along this bearing at the 
distance sj. 


Ji,i 


A h,l 

s jPj ■ 


( 11 ) 


An example system with a camera cluster composed 
of n c = 2 cameras is shown in Figure[4] The cameras in 
this example are arranged back-to-back with the optical 
axes looking outwards along the green axes of the as¬ 
sociated coordinate frames. The / h point feature is an¬ 
chored in the second camera at the first keyframe, CL K \, 
and its position with respect to this coordinate frame is 
represented as py 1 . 


The parameters representing the poses of the key- 
frames, together with the positions of the point fea¬ 
tures observed within them, compose the target model, 
as well as the full system state. These parameters are 
estimated using the point feature image measurements 
within the cluster cameras. 

3.5. Multicamera Cluster SLAM System 

This work considers the motion and structure estima¬ 
tion for a cluster of n c cameras observing a set of iif 
point features over two keyframes. The cameras within 
the cluster are arranged with little or no overlap in their 
FOV where each point feature in the target model is vis¬ 
ible in only one camera at the first keyframe. Without 
loss of generality, the target model frame is chosen to 
coincide with the pose of the first keyframe M = C\K\. 
This results in the keyframe transformation becoming 
the identity. 


Ttf, = 14X4. (12) 

Several further assumptions about the system are 
made to facilitate the analysis in the subsequent sec¬ 
tions: 

Assumption 3.1. Each point feature is observed and 
measured by only one of the component cameras at the 
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first keyframe. The position of the point feature is ex¬ 
pressed with respect to the coordinate frame for that 
camera at the first keyframe. The coordinate frame in 
which the point feature is parameterized is referred to 
as the anchor keyframe and camera coordinate frame. 


for the cluster motion between the keyframes. 


Xl 


X2 


X 3 


( 13 ) 


Assumption 3.2. Each point feature is observed and 
measured by one or more of the component cameras at 
the second keyframe. At least one of the observations is 
by a camera for which its motion is not collinear with 
the initial bearing to the point feature at the first key- 
frame. The camera and keyframe in which the observa¬ 
tion occurs is called the observing keyframe and camera 
coordinate frame. 


where 

Xl s n/ ] T eR"/, (14) 

are the radial distances to the point features, 

x 2 = [t K T ,co K T ] T eR 6 , (15) 

are the relative position and orientation of the first key- 
frame with respect to the second keyframe and, 


Assumption 3.3. The point feature positions and key- 
frame poses are arranged such that if a camera observes 
a point feature, the feature position expressed in the ob¬ 
serving camera coordinate frame has a finite positive 
non-zero z-axis component, 0 < z < oo. 

For Assumption ITT1 the function li : {1,...,«/} —> 
{1,..., n c ) maps the point feature index to the anchor 
camera index. As a result, the anchor camera for the 
/ h point feature is camera li(j). In the following, when 
it is obvious from the context, the anchor camera index 
will be written in the shortened-form by dropping the 
argument, h = h(j). 

Similarly for Assumption 13.21 the / h point feature 
is observed and measured by n a (j) e N + cameras at 
the second keyframe. The indices of the observing 
cameras are found using the function i : {1,...,«/) x 
{],..., n„(j)) —> {1,.. .,n c }, such that the k th obser¬ 
vation of the / h point feature at the second keyframe 
is measured by camera i(j,k). Once again, this will 
be shortened to exclude the feature index j and ob¬ 
servation index k when it is implied by the context, 
i = i(k ) s i(J, k). 

The motion of the camera cluster between the two 
keyframes is parameterized by six values describing 
the relative translation and orientation of the first key- 
frame with respect to the second keyframe. The transla¬ 
tion parameters, t x , t y , t z , form the relative translation 
vector, tx = [t x , t y , f-] T , and the rotation parameters, 
o>k = [oj x , ajy, cj z ] t , form the relative rotation matrix, 
'R k e S 0(3). Together, the rotation and translation form 
the transformation, T k e S E( 3). 

The resulting state vector, x e R", where n — 6 + 3 n /, 
is composed of the parameters for the n / point features, 
along with the relative translation and orientation states 


*3 = (16) 

are the bearings to the point features in their respective 
anchor camera coordinate frames. This state order has 
been specifically chosen in order to facilitate the analy¬ 
sis of the degeneracies of the solution presented in Sec¬ 
tion [4] 

3.6. Camera Cluster Measurement Model 

The system measurement vector, z e R"', is formed 
by stacking the image plane coordinates of all of the 
point feature observations in all cameras at both key- 
frames, where m = 2(nf + m 0 ) with 

n f 

= (17) 

i= i 

as the total number of observations of all of the point 
features at the second keyframe. 

The measurement model, relating the observed point 
feature locations in the camera image planes, to the sys¬ 
tem states, can be written as a series of coordinate trans¬ 
formations. Suppose that the / h point feature, anchored 
in the coordinate frame C/, K \, is measured by camera i 
at C,K 2 . An example of this chain of transformations 
is shown for the simple back-to-back two-camera clus¬ 
ter system in Figure [4] In this particular case, the point 
feature j is anchored in C 2 K\ and observed in C 2 K 2 . 

The point feature position parameters give the loca¬ 
tion of the / h feature in its anchor keyframe and camera 
frame Ci,K \, resulting in p / ' 1 . This point feature is first 
transformed into the target model coordinate frame by, 

pf = T Jfl T Ci pf (18) 

= Tc,P-’ I ) (19) 
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which is the transformation provided by the known clus¬ 
ter calibration. 

The point feature position, with position estimate ex¬ 
pressed in the target model reference frame, is trans¬ 
formed into the coordinate frame of the observing key- 
frame and camera C;K( using the relative keyframe pose 
transformation, TV, and the cluster calibration. 


: f = Vf 

-1 


i,€ 11 T 

Z,- 1 J 


J 

= (T Ci .)- 1 (T^)- I pf 

= (Tc^-'CT^r'Tcjf. 


( 20 ) 

( 21 ) 

( 22 ) 


Finally, the point is projected into P 2 and onto the 
image plane of camera C; using the corresponding pro¬ 
jection matrix, k,. 


uf - [u 


= K *j 


z j 


(23) 

(24) 

(25) 


which leads to the resulting measurement vector z': f e 


and mapping gj: 


for the observation of 


point feature j in camera i at keyframe (, 

^ = (26) 

Each of the intermediate transformations in (l22l > can 
be represented by a rotation matrix and translation vec¬ 
tor. 


T c„ = 


Tjfj - 


Tc, = 


0lx3 

I^K, 

0lx3 

Kr 


1x3 


tc„ 

1 

t K e 

1 

t C; 

1 


14x4, 



h ^ 

“^A't K 


0lx3 

1 


’ = 1 
’ = 2 


(27) 


(28) 


(29) 


= 


i,{ 


(31) 

(32) 


where 


with 


q '■ - s jh j,t + bf + c Kt + d, 


ht = KlKc&Y 


b e = 

c h,e = Klt Ch 
d, = -t c , 


and 


Kq = [ft;,* n ; , y n,., | e 5(9(3), 


(33) 

(34) 

(35) 

(36) 

(37) 

(38) 


where n ix , n ( - v , and n,_, are the orthonormal basis vec¬ 
tors for the observing camera i frame with respect to the 
camera 1 coordinate frame. An example system con¬ 
sisting of the cameras observing point features over two 
keyframes is shown in Figure [3 with the intermediate 
variables labelled. 

The set of camera observation vectors for point fea¬ 
ture j is defined as the displacements between the an¬ 
chor camera coordinate frame at the first keyframe, 
C/,Vi, and the centres of each of the observing cam¬ 
eras at the second keyframe, C,-(C)^ 2 , VA: e {1,..., n 0 (j)}. 
The set of vectors are, 

V = {Va,p 6 M 3 |ar,/? e N + ,cr < «/ and/? < n 0 (a)}. (39) 

Therefore, if it is included in the set V, the camera ob¬ 
servation vector can be written as, 

'/afi — b 2 + C h(a),2 + d (40) 

and is illustrated in the example system shown in Fig¬ 
ure [6] 

The image coordinates of each individual point fea¬ 
ture observation measurements are then compiled into a 
vector for point feature j containing all of the individual 
observations of that feature at both keyframes, 

j(D,2- 


When (l27l >— (l29l) are substituted into ( 122b along with 
(HD- the coordinates of the point feature position in K 3 
become, 

Pf = sjKl<RlK Ch vY - KIRIt K[ + K T Cl Kl tc* - «J,tc, 

(30) 

= (sjKlKctf 1 - + Ufa ~ tc,) 


i(n 0 ), 2 


,h, 1 


t>2+2/7 0 


(41) 


where n„ = n a (j) is the number of observations of the 
j lh point feature at the second keyframe. 

The full system measurement vector is composed of 
the observations of the n / point features at both key- 
frames. 


Zl 


( 42 ) 

























Figure 5: An example three-camera cluster observing point features over two keyframes with intermediate vectors 
labelled. Vectors are parameterized with reference to keyframe CiKj. 


4. Degeneracy Analysis 

4.1. Solution Degeneracies 

Typical optimization methods attempt to minimize a 
nonlinear cost function, c : R" —» R, and determine the 
optimal state vector estimate, x* e R", such that, 

x* = argmin c(x). (43) 

X 

The optimization proceeds iteratively, starting with an 
initial state estimate, Xq 6 R". Each iteration seeks to 
update the current state estimate, x*, with a vector 8 k e 

R", 

x k+ i = x k + 8 k , (44) 

such that the sequence {xo,Xi,X 2 ,...} —> x*. In this 
analysis, a cost function relating to sum of squared mea¬ 
surement error is assumed, 

c(x k ) = ^xjik, (45) 


where z k — z - g(x*) e R"‘ is the measurement error 
vector at iteration k. A commonly-used method for BA 
is the Levenberg-Marquardt (LM) method @], although 
other optimization methods may be used such as Gauss- 
Newton, gradient descent, or Newton step. Each of 
these optimization methods can operate using the sum 
of squared reprojection error and the parameter update 
8k is defined as the solution to, 

m = J T Z * (46) 

where N is the normal matrix, which varies by optimiza¬ 
tion method, and J is the measurement Jacobian such 
that, 

J = e R mX ". (47) 

OX x=x/c 

Solving for 8, t, the solution becomes, 

8 k = N-*J T z k , (48) 
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Figure 6 : An example two-camera cluster observing 
three features. Each feature is observed in one cam¬ 
era at the first keyframe, but some are seen by different 
cameras at the second keyframe. The camera observa¬ 
tion vectors, vi,i, V 34 link the cameras which see 
the same feature at the different keyframes. 


where z* = z - g(x/J is the measurement error. A unique 
6k can be found as long as the matrix N is invertible and 
the Jacobian has full rank. Therefore, the system in (l46t 
is degenerate when. 


rank (J) < n, (49) 


observation adds two rows to the Jacobian, 




dx 


02xn/+6 02x20-1) 


( 50 ) 



02x2(n / -2) » 

(51) 


where the only non-zero elements are in the 2 x 2 block 
relating the measurement coordinates to the point fea¬ 
ture bearing states, 

0 
1 

cos {<pf) cos ((/> j) cos (6j) 2 

(52) 


<9g' U (x) 


llU ; 


-tan (<pj) 2 - 1 
tan ((f>;) tan (Of) 


The non-zero element structure of these rows are shown 
in Figure |7] 


Sj t X ty X 0j 



Figure 7: Structure of the Jacobian rows for the mea¬ 
surement of the point feature j in its anchor camera at 
the first keyframe. Non-zero elements are shown as the 
shaded cells. The columns not related to feature j con¬ 
tain only zeros and have been removed for conciseness. 


and the solution is under-constrained. The cases where 
the system becomes degenerate are the focus of this 
work and are investigated in the next section. 


4.2. Identification of Degenerate Configurations 


This section identifies the configurations of the cam¬ 
era cluster geometry, relative motion, and target model 
structure, for which the Jacobian J falls below full col¬ 
umn rank. It is shown that for the assumptions stated 
previously, the m x n measurement Jacobian matrix J 
has full rank if and only if a m„ x 6 matrix, M 2 has full 
rank. 

To determine the rank of the Jacobian matrix, the 
structure of the sub-blocks formed for the point feature 
observations is investigated. Each point feature j is ob¬ 
served by only one camera at the first keyframe. This 


Each point feature j is also observed and measured by 
at least one camera at the second keyframe. The Jaco¬ 
bian matrix rows corresponding to the k* observation of 
point feature j in the second keyframe with camera i(k') 
are the partial derivatives of the measurement equation 
(l26l > with respect to the system states, 


t «(*),2 

J j 


dg f’ 2 (x) 


dx 


f^(«n 

\ 

' do '®- 2 

\ 

3 a 1 '®’ 2 

J 


dx 

x=x/ 


(53) 

(54) 


using the chain rule. Dropping the implied x = x, the 
first term evaluates to. 


3uf w 


1 


( U-, ) 2 

1 


ff'T 


0 -u x 

My 

-1 0 
0 0 



(55) 

(56) 
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where [a] x is the skew-symmetric matrix such that 
[a] x b = a x b, Va, b e R 3 . 

Substituting (l56l ) back into (l54b and recognizing that. 




-1 0 0 

0-10 

0 0 1 


KJ. q‘ (k> ’ 2 . 


(57) 




Figure 8 : Structure of the Jacobian rows for an observa¬ 
tion of the point feature j at the second keyframe. 


Sj t*x t"y tz @j 



the Jacobian rows can be written as. 
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i 




o 1 o 

-10 0 

0-10 

1 0 0 


[of 2 ] 


f)u 


m, 2 


x dx 


(58) 


dq Kk) ’ 2 

*U<“L 2 


Jx dx 


x qf'' 2 ) T 

(fl W ,xqf' 2 ) T 


d<l 


m,2 


dx 


(59) 

(60) 


where the partial derivatives of the point feature position 
at the second keyframe with respect to the system states 
are written, 


3q 


m, 2 


dx 


0 


3x0-1) 


dqf>' 2 

dsj 


0 


3x( n f -j) 


0 




dt K 

m, 2 


d(jL> K 


3x20-1) 


d[l: 


0 


'3 X2(n f -j) 

(61) 


with the position change with respect to the radial dis¬ 
tance. 


<9q 


m,2 


ds: 


= a ;,2. 


the translation between the keyframes, 

„<(*), 2 

= I3x3> 




dt R 

the rotation between the keyframes. 


<9q 


m, 2 


dto R 


■ 


(62) 


(63) 


(64) 


and the initial bearings to the point feature. 


dt 


m,2 


dn: 


- Sj'Rx'Rci 


cos (f>j cos 6j - sin cf>j sin 6j 


0 


- cos 6; 


- sin tpj cos 6j - cos <f>j sin 9j 


(65) 


The structure of the Jacobian rows associated with the 
observations of point feature j at the second keyframe 
is shown in Figure [ 8 ] 

The full measurement Jacobian is formed by stacking 
all of the observations of all of the point features at both 
keyframes, 

f i(U),2 

•i 


dqf ’ 2 Sqf ’ 2 


J 

J i 


j(l,n 0 (l)),2 

I*(l),l 


( 66 ) 


wi(n f , 1),2 


wi(n f ,n 0 (nf)),2 

In/ 

T /i(n/).l 


The configurations for which this measurement Ja¬ 
cobian possesses full rank can be identified by checking 
the rank of a reduced-dimension matrix, as shown in the 
following Lemma. 

Lemma 4.1. For a multicamera cluster SLAM system 
satisfying Assumr>tions \3. /] 13.21 and \3.3\ the rank of the 
measurement Jacobian matrix J in (166b is full if and only 
if the rank of the matrix, 


X, 2 [v u ] x an[ v u] x [wi] > 


M 2 = 


-a [, 2 [vi.n„(i)] x a [ 2 [vi,„ o( i)] x [wi]> 


-a 


«/. 




«/. 


IvLKL 


Kf ,2 [ V »/-"o(n/)] x K f ,2 [ V "/-"o("/)] x [ W »/]>. 


( 67 ) 


where 


is full. 


w y — s j a jJ + c /i(J).2> 
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Proof. The strategy is to first show that the columns of 
J corresponding to the point feature positions ( sj , // ; ) 
have full rank. Consequently, the only way for the Jaco¬ 
bian to have less than full rank is when the columns cor¬ 
responding to the keyframe motion Hk, 7 ?k ) have rank 
less than six. 

By Assumption 13.31 the position of the / h point fea¬ 
ture in its anchor camera and keyframe ensures that 
cos {(f>j) > 0 and cos (Of) > 0. As a result, the block (l52l > 
always has a rank of 2 since the determinant is non-zero. 


(dg h /\x) 


-1 

d 9j 

x=x/ 

cos (<pj) 3 cos (8j) 2 


* 0 . 


( 68 ) 


row operations matrix. 


O 


m, 2 




'm,y 


0 

1 

[«rW 

0 




0 


12 x2, 


if Sy 0 
if S* = 0, Sy + ( 


if S X £ 0, Sy = ( 
if s x , Sy = 0, 


(71) 


in order to achieve the desired structure K '^ 12 for the 
Jacobian rows. 


Therefore, it is possible to diagonalize the sub-block 
using elementary row and column operations without 
changing the rank of the matrix. After diagonalization, 
the new matrix rows, K*’ 1 , have the structure shown in 
Figure [9] As a result, the columns corresponding to the 
bearing states // / have full rank for all of the point fea¬ 
tures. 


2 _ i (*), 2 n f (*), 2 T ;(*),2 

j '\i J J j 


(72) 


which is shown in Figure [TO] 
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Figure 9: Structure of the Jacobian rows for the mea¬ 
surement of the point feature j in the first keyframe after 
diagonalizing the bearing sub-block. 
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Additionally, the columns associated with the point 
feature radial depth parameter Sj for an observation at 
the second keyframe contain only zeros when, 

Mx ®* 2 = ° 2xi ’ ( 69 ) 


-n 


i(k),y 


Figure 10: Element structure of the modified Jacobian 
rows associated with measuring point feature j at the 
second keyframe. 


The second row of the matrix K'^’ 2 , labelled k' 

j j 


Kk), 2 


becomes, 

k Kk),2 


[0 k Sj 0 k tf , 
1 




0] (73) 


d<i 


m, 2 


jm, 2 


("«>„lf 2 )(lf 2 x*p) ~t~ ,74 > 


= ([b 2 + C h?2 + d,] x a ; , 2 ) 


T 3qf ’ 2 


dx 


(75) 


where the element associated with the radial distance 
parameter is zero. 


the displacement between the anchor and observing 
camera coordinate frames is collinear with the initial 
bearing to the point feature in the anchor camera frame. 
In this case, there is no information about the depth of 
the feature within this measurement since the triangula¬ 
tion baseline has zero length. However, by Assumptions 
I3.2l and l373l there exists an observation k e {1,..., n 0 (j)\ 
such that, 

| v a] x a ; ,2 + 0 2x i , (70) 

and therefore, at least one non-zero element in the col¬ 
umn. The matrix rows J^’~ are manipulated using the 


k Sj = ([b 2 + c /2 , 2 + d,] x a/, 2 ) T a /, 2 (76) 

= (b 2 + c/,,2 + d,) T |a ; , 2 | x a />2 (77) 

= 0, (78) 

and the columns for the keyframe motion states are now, 
k t/c = J 2 [ b 2 + Ch.2 + d/ ( fc)] x (79) 

= - a J 2 h-4 . ( 80 ) 

and, 

k «A- = a J 2 P >2 + c h ,2 + d, w ] x [sjkj '2 + c Aj2 ] x (81) 

= a I 2 M x N x - ( 82 > 
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All of the modified Jacobian matrix rows for the point 
feature j observations at both keyframes are then com¬ 
piled into a single block. 


K; = 


id),2 


K 


jjri( n o),2 

k m 

J 


(83) 



which maintains the same rank as the original Jacobian 
block for the point feature. 


<9g,(x) 


<9x 


(84) 


since the manipulations are performed by full rank el¬ 
ementary row and column operations matrices. The 
resulting matrix block has the structure shown in Fig¬ 
ured]] 
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Figure 11: Structure of the manipulated Jacobian block 
for point feature j stacking all of the observations at 
both keyframes. 


It can be shown that the odd-numbered rows of Ky 
may always be written as a linear combination of the re¬ 
sulting even-numbered rows. Additionally, elementary 
row operations can eliminate all but the last elements 
in each of the columns associated with the point feature 
bearing states, (f>j and 6j. Finally, the non-zero element 
in the sj column can be used to eliminate the remaining 
non-zero elements in the first row. Subsequently, this 
new matrix, Ly has the same rank as the original Jaco¬ 
bian block J j for this point feature and the structure is 
shown in Figure [12] 

The matrix M is formed by stacking and reordering 
all of the Ly matrices for j = 1 ... rif and has the same 
rank as the original Jacobian J. The structure of matrix 
M is shown in Figure [13] 

The matrix M is a block-diagonal matrix composed 
of three sub-matrices: 


Figure 12: Structure of the Jacobian block Ly for the 
point feature j observations, resulting from manipula¬ 
tions to the original Jacobian. 



Figure 13: Structure of the matrix M, resulting from 
stacking and reordering the rows of the matrices Ly. The 
sub-blocks of M are shown and all must be full rank for 
M, and therefore J, to be full rank. 


• M 2 e R" 1 '’* 6 , 

• M 3 e R 2n f x2n f is diagonal. 

As a result, M and J are full rank if and only if all of the 
following are satisfied. 


Mi e W' fXnf is diagonal. 
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rank(Mi) = «y, 





































































































































































































































































































































• rankfMa) = 6 , and 

• rank (M 3 ) = 2 iif. 

It is clear that both M| and M 3 are full rank by con¬ 
struction, and therefore, M and by extension J are full 
rank if and only if Mi is full rank, which concludes the 
proof. □ 

Therefore, determining if the measurement Jacobian 
J is full rank is simplified to checking the rank of the 
reduced-dimension matrix M 2 . It follows directly from 
Lemma 14.11 that the degeneracy of the multicamera 
cluster SLAM system can be determined by checking 
the rank of M 2 . 

Corollary 4.2. For a multicamera cluster SLAM sys¬ 
tem satisfying Assumptions 13.71 L',21 and \3.3\ the solu¬ 
tion is degenerate and under-constrained, if and only if 
rank (M 2 ) < 6 . 

4.2.1. Rank of M 2 

The matrix M 2 is a dense m„ x 6 block with a sin¬ 
gle row for each observation of the point features at the 
second keyframe. Each row of M 2 in (l67l > specifies the 
six Pliicker coordinates for a line in R 3 since each set 
of coordinates satisfies the Grassmann-Pliicker relation 

J3, 


(MxM-(NxMxM 

(85) 

= -wr(fh iW l x M x (hw] x M) 

( 86 ) 

= o. 

(87) 


The matrix M 2 will not have full rank when the m 0 
sets of coordinates are linearly-dependent. This is sim¬ 
ilar to the problem of identifying motion singularities 
for series-parallel mechanisms. However, the current 
problem is more complex since the common connection 
points which sometimes allow for the simplification of 
the singularity condition in mechanisms are not present 
in the cluster SLAM system. 

4.3. Sufficient Conditions for Degeneracy 

In this section, the structure of the matrix M 2 from 
(l67l > will be exploited to identify cluster configurations 
and motions that are sufficient for degeneracy of the so¬ 
lution, independent of the number of point features ob¬ 
served and their constellation geometry. 

It is immediately apparent that the system must in¬ 
clude six point feature observations at the second key- 
frame for the matrix M 2 to possibly have full rank. The 


first three columns in M 2 are a stack of cross products 
involving the camera observation vectors and the bear¬ 
ings to the point features. When they all have a com¬ 
mon collinear vector operand, the resulting row vectors 
are all coplanar, with the normal defined by the collinear 
vector operand. 

As expected, the system will be degenerate if the 
cluster consists of only one component camera since 
the rows will all have a common camera observation 
vector, consistent with how monocular vision systems 
are unable to recover the six degrees of freedom motion 
solution in a SLAM system. Additionally, the system 
is degenerate when only one point feature is observed 
by six cameras at the second keyframe since all of the 
matrix rows will contain the common point feature unit 
vector, ai, 2 . in the cross product term. 

When the camera observation vectors are all parallel, 
the SLAM solution is degenerate. Each camera observa¬ 
tion vector can be written as a scalar multiple, 3 y m ,n £ R 
such that \„ un = y m> „v ell In this case, the matrix M 2 
will have less than full rank since. 


rank 


-n,ia [ 2 [v] x 


yn f ,n 0 (nf)& nfi 2 t v lx 


< 2 < 3, 


( 88 ) 


and rank (M 2 ) < 6 . This condition includes the previ¬ 
ously known two-camera cluster concentric circle de¬ 
generacies, since the motion causes the camera centres 
to move in parallel. Adding more cameras to the cluster 
reduces the configurations for which the relative motion 
will lead to the camera observation vectors being par¬ 
allel. Additionally, when point features are observed 
across different cameras within the cluster at the two 
keyframes, it becomes less likely that all of the camera 
observation vectors are parallel. However, there do ex¬ 
ist certain combinations of cluster motions for which the 
camera observation vectors remain parallel regardless of 
the feature point locations, and the camera cluster sys¬ 
tem becomes degenerate. Some example configurations 
are presented in Figure fl~4l 

When the relative motion of the camera cluster is 
such that a point feature which was observed in one 
camera at the first keyframe is observed by a different 
camera at the second keyframe, there is a camera obser¬ 
vation vector between the positions of the two cameras 
when they observed the particular point feature. This 
can create a set of camera observation vectors which 
are non-parallel even when the relative motion is a pure 
translation. As a result, it is possible that the system 
is non-degenerate and the solution can be found in this 
case, depending on the rank of the matrix M 2 . Observ- 
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Figure 14: Examples of camera cluster motions sufficient for degeneracy. The black dots are the cameras at the first 
keyframe connected by solid lines, white dots are the cameras at the second keyframe connected by dashed lines. The 
dotted lines are the camera observation vectors which are all parallel. Motions include (a) pure translation with no 
intercamera correspondence, (b) rotation axis in the plane of planar four-camera cluster, (c) 90 degrees rotation with 
translation, (d) two-camera concentric circles motion. 


ing common point features over multiple cameras is an 
effective way of avoiding the set of camera observation 
vectors becoming parallel and reducing the set of suffi¬ 
cient motions for system degeneracy. 

4.4. Necessary and Sufficient Conditions for Degener¬ 
acy 

In the case when the motion does not produce paral¬ 
lel camera observation vectors, it is necessary to eval¬ 
uate the rank of the matrix M 2 before concluding that 
the system is non-degenerate. The matrix M 2 can be re¬ 
garded as a set of motion constraints on a mechanism 
where a non-full rank means that the framework is not 
rigid and the configuration can change without violat¬ 
ing the constraints. The full analysis of these singu¬ 
lar configurations is beyond the scope of this work, but 
this section presents a set of example configurations for 
some general case systems to numerically demonstrate 
the effect of adding additional cameras and point feature 
observations on the degenerate configuration set. 

Figures fl5al and fl5bl show typical surface meshes for 
the relative cluster translation, tleading to M 2 los¬ 
ing rank for example two and three-camera cluster sys¬ 
tems observing six point features with no overlap in the 
camera observations and non-zero relative rotation. The 
surface is computed numerically as the locus of zero de¬ 
terminant for the matrix M 2 using a set of randomly- 
positioned point features. A similar surface is generated 
for any non-zero rotation Rk- 

As more point feature observations are added to the 
system, the number of degeneracies is reduced. With 
more than six point feature observations, the size of the 
matrix M 2 becomes m„ x 6 , where m 0 > 6 and therefore 
the rank of the matrix cannot be checked by computing 
the determinant directly. Instead, for the matrix to not be 
full rank, all of the m 0 choose 6 submatrices of size 6x6 
formed by the rows of M 2 must have a zero determinant. 




Figure 15: Degenerate tx for (a) two and (b) three- 
camera clusters, observing six points with no overlap 
and non-zero rotation. 
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tx (m) 

(a) 7 points 



(b) 8 points 

Figure 16: The loci of zero determinants for the m 0 
choose 6 submatrices of M 2 at t z = 1 m in the three- 
camera cluster case for (a) m a = 7 and (b) m a = 8 
point features. The degenerate points are the intersec¬ 
tions marked with black circles. 


Each of the submatrices generates a surface as in Figure 
[T5l and therefore, M 2 has deficient rank at the where 
all of the surfaces intersect. 

A two-dimensional cross-section ath, = 1 m is shown 
in Figure [T6] for the three-camera case observing 7 and 
8 point features with no overlap and non-zero rotation. 
The degenerate cluster translations correspond to the 
points on the graph where all of the curves intersect and 
are marked as black circles. These intersections are de¬ 
termined numerically using the computed loci for the 
determinants of the submatrices. If all of the loci in¬ 
tersect with each other within a certain epsilon ball, the 
location is selected as a degeneracy of M 2 . 

Notice that the number of degenerate motions is re¬ 
duced from the curves of each colour for a subset of 


six feature observations, to a small finite set of points at 
any given cross-section. While the indicated degenerate 
positions are subject to numerical precision considera¬ 
tions, these examples are more informative in demon¬ 
strating that the system is non-degenerate in almost all 
configurations. 

It is observed that the degenerate points in Figure [T6al 
connect as lines in R 3 at different slices of t z . When 
observing eight points in general position. Figure I16bl 
shows that there are no translations for which the system 
is degenerate. While not exhaustive, numerical analysis 
of the singular configurations of M 2 shows that the set 
of degenerate motions in the cluster system has been 
reduced from the previous surface with m 0 - 6, to a set 
of lines with m 0 = 7 and the empty set for m 0 = 8. 

Adding point feature observations to the system is an 
effective way to reduce the set of degenerate motions 
for the camera cluster system; however, the sufficient 
conditions in Section 14.31 remain no matter how many 
point features are observed. Examples of these degen¬ 
eracies are shown in Figure fTTal for a two-camera cluster 
and Figure [l7bl for a three-camera cluster with rotation 
purely in the camera centre plane jgt]. 

The indicated degeneracy corresponds to the motion 
causing the camera observation vectors to move in par¬ 
allel and extends along a line in R 3 . In order to eliminate 
these motions, it is necessary to add more cameras to the 
cluster, observe point features over different cameras, or 
both, to ensure that not all of the camera observation 
vectors are parallel. 

Multiple cameras observing the same point feature 
at the different keyframes adds extra camera observa¬ 
tion vectors which are less likely to be parallel with 
the rest of the vector set and produce a full-rank M 2 . 
An example two-camera cluster observing eight point 
features is shown in Figure [18] Camera 2 observes a 
feature at the second keyframe that was measured by 
camera 1 initially, and camera 1 observes a feature from 
camera 2. Significantly, there is no relative rotation be¬ 
tween the keyframes of this system, but the rank of M 2 
is full nearly everywhere. This is an improvement on 
the previous completely non-overlapping cluster con¬ 
figurations which required non-zero rotation to have a 
full-rank M 2 . 

The example systems in this section demonstrate nu¬ 
merically the effect of adding cameras and point feature 
observations to the camera cluster SEAM solution. For 
any algorithm, the overall strategy should be to reduce 
the number of degenerate configurations by increasing 
the number of point features observed on the target, and 
then eliminating the remaining sufficient conditions for 
degeneracy by adding cameras to the cluster, or observ- 
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tx (in) 



(aj Two cameras 



t x (m) 

(b) Three cameras 

Figure 17: The loci of zero determinants for the 8 
choose 6 submatrices of Mi at t z — 1 m in the (a) 
two-camera and (b) three-camera cluster case with rota¬ 
tion axis within the camera centre plane observing eight 
point features 


Figure 18: The loci of zero determinants for the 8 
choose 6 submatrices of M 2 at f- = 1 m in the two- 
camera cluster system with zero rotation between key- 
frames, but two common features across cameras. 

ing point features across cameras, such that it is im¬ 
possible for all of the camera observation vectors to be 
parallel through the motion. This will ensure a well- 
constrained solution to the localization and mapping 
problem. 

5. Conclusions 

This work presented a detailed analysis of the degen¬ 
erate configurations of the calibrated non-overlapping 
FOV multicamera cluster SLAM problem for an opti¬ 
mization based on minimizing a least-squares cost func¬ 
tion with respect to the image-plane reprojection error. 
The system is reduced to a simple matrix rank test on 
a matrix consisting of rows of Pliicker coordinates for 
lines in R 3 . Sufficient configurations for solution de¬ 
generacy caused by the relative motion were identified 
for H f -camera clusters observing any number of point 
features over two keyframes. This leads to the novel 
general conclusion that if all of the camera observation 
vectors, formed as the displacement between the pairs 
of cameras observing a particular point feature, are par¬ 
allel in a common coordinate frame, then the system is 
degenerate. It is further shown for several example sys¬ 
tems that with the addition of more cameras to the clus¬ 
ter, more point feature observations, and observations 
of the point features across different cameras, the set of 
degenerate configurations is significantly reduced as it 
becomes impossible for all of the identified vectors to 
be parallel and the redundant observations prevent all of 
the determinants of the submatrices from going to zero 
concurrently. 
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Future work will focus on fully characterizing the 
necessary and sufficient conditions for the system to be¬ 
come degenerate, including the degeneracies related to 
the geometry of the point feature constellation from the 
standpoint of geometric algebra techniques I123fl . Ad¬ 
ditionally, the results from this work will be used to 
generate metrics for deciding when and where to add 
keyframes in a real-time SLAM system to accurately 
construct and constrain the generated target model and 
avoid the degeneracies within the state space caused by 
measurements from this type of sensor. 


projective space P" simply by augmenting the coordi¬ 
nates, 

x = [x T l] T . (A.4) 

The projective spaces allow for projective and coor¬ 
dinate transformations to be represented as linear matrix 
operations. 
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Appendix A. Projective Geometry 

The projective space, P", consists of the real vector 
space R", with the addition of points at infinity 0. Only 
a very brief description of the projective space is pre¬ 
sented here and the reader is referred to [2l for a more 
thorough introduction. 

A point in the projective space is represented by the 
n + 1 homogeneous coordinates, 

x = [xi x 2 ... x„+i] T eP". (A.l) 

The points at infinity in R" are represented by those with 
coordinate x n +i = 0. For finite points in R" - when 
x n +i + 0 - the coordinates of the corresponding point 
x 6 R" are determined by, 

x = [xi x 2 ... x„] (A.2) 

X, X 2 Xn 1 T 

= ~~~ ■■■ ~z~~ ■ (A.3) 

Xn +1 X«+l X/z+1 - 

Note that there is no way of mapping a point at infinity 
back to R" since it would require division by zero. 

Each point along a ray in the projective space maps 
to the same point in the real vector space. As a result, 
the points x and Tx, for iel, map to the same point 
x e R". Not surprisingly, there is an extra degree of 
freedom in the projective vectors using n +1 coordinates 
to represent a n-dimensional space. Finally, it is possi¬ 
ble to represent any point x e R" in the corresponding 
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